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Abstract 



Let {^n} be a sequence of independent and identically distributed random variables. In 
p I ■ this paper we study the comparison for two upper tail probabilities ^nlCnl^ ^ ^} 

(— I ' ^ {J2'^=i t'n\S.n\^ > r} as r cx) with two different real series {a„} and {6„}. The first result is 

I for Gaussian random variables {^n}, and in this case these two probabilities are equivalent after 

suitable scaling. The second result is for more general random variables, thus a weaker form of 
equivalence (namely, logarithmic level) is proved. 
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^ 1 Introduction 

^ ' Let {S^n] be a sequence of independent and identically distributed (i.i.d.) random variables, and 

\ {an} be a sequence of positive real numbers. We consider the random series X^J^i "nCn- Such 

random series are basic objects in time series analysis and in regression models (see [2j), and 
there have been a lot of research. For example, [5J and [6j studied tail probabilities and moment 
estimates of the random series when {in} have logarithmically concave tails. Of special interest are 
the series of positive random variables, or the series of the form Xln^i On|'?n|^- Indeed, by Karhunen- 
Loeve expansion, the L2 norm of a centered continuous Gaussian process X{t),t £ [0,1], can be 
represented as ||^||l2 = J2'^=i^nZn where A„ are the eigenvalues of the associated covariance 
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operator, and Z„ are i.i.d. standard Gaussian random variables. It is also known (see 0) that 
the series X^^iOnl-^nl^ coincides with some bounded Gaussian process {Yt,t £ T}, where T is a 
suitable parameter set: X^^i an\Zn\^ = sup^yt. 

In this paper, we study the the limiting behavior of the upper tail probability of the series 

asr^oo. (1.1) 

This probability is also called large deviation probability (see p] ) . As remarked in [4j , for Gaussian 
process ||-^||l2 = J2^=i'^nZn, the eigenvalues A„ are rarely found exactly. Often, one only knows 
the asymptotic approximation. Thus, a natural question is to study the relation between the upper 
tail probability of the original random series and the one with approximated eigenvalues. Also, it 
is much easier to analyze the rate function in the large deviation theory when {a„} are explicitly 
given instead of asymptotic approximation. 

Throughout this paper, the following notations will be used. The l'^ norm of a real sequence 
a = {an} is denoted by ||a||g = (X^^i aV)^^'^ . In particular, the l°° norm should be understood as 
||a||oo = max \ an\- 

We focus on the following two types of comparisons. The first is at the exact level 

where {^n} are i.i.d. Gaussian random variables N{a,f5'^); see Theorem 12.11 and Theorem 12.21 This 
is motivated by [3j in which the following exact level comparison theorems for small deviations were 
obtained: as r — )■ 0, IP {EJ!^i '^™|Cra| < ~ cP{E^i^ra|Cra| ^ ^} for i-i-d. random variables 
whose common distribution satisfies several weak assumptions in the vicinity of zero. The proof of 
the small deviation comparison is based on the equivalence form of P{E^i Onl'^nl ^ ^} introduced 
in [8j. Our proof of upper tail probability comparison (|1.2p is also based on an equivalent form 
of IP{E^i^nl?nl — '''} i'^l for Gaussian random variables. The main difficulty is to come up 
with suitable inequalities which can be used for a specified function e(x, y) in Lemma [TT] and such 
inequalities are obtained in Lemma 12.31 and Lemma |2.4[ 

For more general random variables, difficulties arise due to the lack of known equivalent form of 
IP {Enii ^nlCral ^ ^} • Thus, instead of exact comparison, we consider logarithmic level comparison 
for upper tail probabilities 

logP{E~=ia„|^„| > r||a||g} 

- — ^ r^no , ,,, II % ^ 1 as r — > OO. (1.3) 
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It turns out that under suitable conditions on the sequences {a„} and the comparison (II. 3p 
holds true for i.i.d. random variables {Cn} satisfying 

lim li^PlogPll^il >u} = -c 

for some finite constants p > 1 and c > 0; see Theorem 13.11 Here we note that logarithmic level 
comparisons for small deviation probabilities can be found in [4]. 

From comparisons (jl.2p and (jl.3p . we see that two upper tail probabilities are equivalent as 
long as suitable scaling is made. We believe that this holds true for more general random variables; 
see the conjecture at the end of Section [2] for details. 

2 Exact comparisons for Gaussian random series 
2.1 The main results 

The following two theorems are the main results in this section. The first one is on standard 
Gaussian random variables. 

Theorem 2.1. Let {Zn} be a sequence of i.i.d. standard Gaussian random variables N{0, 1), 
and {an},{bn} be two non-increasing sequences of positive real numbers such that J2^=i^n < 
oO'E^^Li bn < oo, 

2 - - — ,,,,,, and 2 ,,, ,, converge. (2.1) 



Then as r ^ oo 



p|J^^an|Z„| >r||a||2| ~P|Xj^"l^«l ^'^Il^ll2|- 

For general Gaussian random variables Z„ , it turns out that the condition (j2.ip is not convenient 
to derive the comparison because some more complicated terms appear in the proof. Therefore, an 
equivalent condition in another form is formulated which forms the following comparison. 

Theorem 2.2. Let {Zn} be a sequence of i.i.d. Gaussian random variables N{a, and {an}, {bn} 
be two non-increasing sequences of positive real numbers such that Y^nLi ^" ^ X^nLi bn < oo, 

( an/\\a\\2\ ^ A an/\\a\\2\^ 

^ ~ h /II/.IL converges, and ^ 1 - < oo. (2.2) 



n=l / II II ^ n=l 



Then as r ^ oo 



.ri=l 



r||a||2/3 + \a\ On > 

n=l ) 

^^{Y, bn\Zn\ > r||6||2/3 + \a\ ^ 6„ 



,71 = 1 



n=l 



2.2 Proofs of Theorem [211] and Theorem [212] 

The function $ stands for the distribution function of a standard Gaussian random variable 
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The first lemma is our starting point. 

Lemma 2.1 (H)- {^^n} sequence of i.i.d. Gaussian random variables N(a,l3'^), and {a„} 
be a sequence of positive real numbers such that Yl'^^=i < Then as r ^ oo 

'an{r - \a\ ^"^^i On) a' 



.n=l 

oo 

n=l ^ " 



/3 



1 - $ 



Eoo 

ll«l|2/3 



(2.3) 



where y) = <l>(x + |y|) + exp{— 2x|y|}<l>(x — \y\). 

Lemma 2.2 (Lemma 5 in [3]). Suppose {c„} is a sequence of real numbers such that X^^^ c„ 
converges, and g has total variation D on [0,oo). Then, for any monotonic non-negative sequence 
{dn}, 



^ Cng{dn] 



n>N 



< {D + sup |5'(a;)|) sup 

X k>N 



J2 c« 

n=N 



As mentioned in the introduction, the key step of the proofs is to come up with suitable 
inequalities that can be used for the function e{x,y) in Lemma l2.ll For the proof of Theorem 12. H 
we need the following 

Lemma 2.3. For a < and small enough 5, we have 

l + a-6< (1 + 5)". 

The proof of this lemma is trivial. The proof of Theorem 12.21 requires a more complicated 
inequality as follows. 
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Lemma 2.4. For a fixed o" > and any 7 > 0, there is a constant \{cr) only depending on a such 
that for any \a\ < a and \6\ < A, 

1 + a • 5 + 7 < (1 + 5f{l + 5^){1 + 7)^. 

The proof of Lemma [2. 41 is elementary (but not trivial) which is given at the end of this section. 

Proof of Theorem \2.1\ By otherwise considering = an/||a||2 and 6„ = ^n/ll^lb; we assume that 
llolb = II&II2 = 1- It follows from Lemma l2. II that 



> r I ~ J] 2«> (ran) • [1 - $ (r)] . 



,n=l 



n=l 



Therefore, 



IP{E^=i«nl^n| >r} ^ (ra„) 



Now we prove that H^Af ^i^{rh \ t^nds to 1 as — )■ 00 uniformly in r. Then the limit of n5S=i %(rh\ 



as r — )• 00 is equal to 1 since the limit of each as r — )• 00 is 1. 

By applying Taylor's expansion to ^ up to the second order, we have 



$ (ra„) =^> (rbn) + (r6„) (ra„ - rbn) 
'^"{rcn) , , ,2 



+ 



(ra„ -rbnY 



where Cn is between and It follows from <I>"(rc„) < that 

^ (ran) ^ ^ ^ rbn^'jrb 

n) I -I 

$(r6„) - ^'(r6„) V^„ 

Let us introduce a new function g{x) = Now we apply Lemma [231 with a = g{rbn) to get 



^ (ra«) ^ ^2 - ^ 



It then follows from Lemma 12.21 that 



n>Af ^ \n>N ^ 



< exp < {D + sup Ifi'(x)l) sup 

a: k>N 



n=N ^ °" ^ 



5 



which tends to 1 uniformly in r from condition (j2.ip . Thus 



Similarly, 



which completes the proof. 



n Ittt ^ 1- 



1— piilfH^i 



□ 



n 



h{ran/\\a\\ 



Proof of Theorem \2.2l From Lemma 12.11 we get 

JPjE^iQnlgnl > r\\a\\2(3 + |a| E^l "nj 
P{En=ibn\U>r\\bh/3 + \a\Zn=ibn} " %6„/||6||2) 

where h{x) = ^{x + |a//3|) + exp{— 2x|a//3|}<I>(2; — |a//3|). Without loss of generality, we assume 
Iklb = ll^lb = 1- We use the notation /(x) = exp{— 2x|a//3|}<&(x — |q//3|), thus 

h{ran) = $(ran + \a/(3\) + /(ra„). 



Now we apply Taylor's expansions to ^ at point rbn + |a//3|, and to / at point rbn both up to the 
second order, so 



h{ran) =Hrbn + \a/(3\) + r6„$'(r6„ + |a//3|) (^^ - 1^ 



+ $"(rci,„ + |a//3|) (ra„ - r6„) V2 



+ firbn) + rbnf'irb„ 



n ryj"{rc2 



n) I ""n 



bn J 2 
where ci „ and C2 n are between a„ and 6„ . Because < 



/i(ra„) <h{rbn) + r6„ [<I>'(r6„ + |a//3|) + /'(r6„)] (^^ - 1 

r^blf"{rc2,n) (an ^ " 

2 \bn 

Taking into account that |r^6^/"(rc2,„)| < 2c(|a//3|) for large N uniformly in r with some positive 
constant c depending on |a//3|, we have 

hjran) ^ ^ ^ rbn [^'{rbn + |a//?|) + fjrbn)] fan A , ^ 
/i(r6„) ~ h{rbn) \bn J \bn 
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The function g{x) := x [^'{x + |a//3|) + f'{x)] /h{x) is bounded and continuously difFerentiable on 
[0,00) with a bounded derivative. Therefore it fohows from Lemma 12.41 that 



l + c(^-l 

Or,, 



By taking the infinite product, we get 
h{ra 



n 



h{rb„ 



< 



n=N ' n=N ^ " ^ n=N 

According to Lemma 12.21 the first product 

girbn) 



l + c( -^-1 

Or, 



n 

n=N 



{ X] 9{rbn) log 



n>N 



< exp < {D + sup I (7(2:;) I) sup 

X k>N 



which tends to 1 because the series X^^i log y^j is convergent (this is from condition (|2.2p . see 
Appendix for more details). 

For the second product, we use 1 + x < to get 



n 1+ 



n=N 



bn 



1 



2\ / / \ 2^ 

Or,, 



< exp < 



n>N ^ " ^ 



and this tends to 1 because of (12.21). Thus 



limsup 



n=N 



We can similarly prove lim supjy^oo H^at ^(ra") — which ends the proof. 



< 1. 



□ 

Proof of Lemma \2.4\ We first show that under the assumptions of Lemma 12. 4^ the following in- 
equality holds 



l + a-5< (1 + (5)''(1 + (52). 
Let us consider the function p(6) for \6\ < 1 and \a5\ < 1 defined as 

p{5) = alog(l + 5)+ log(l + (5^) - log(l + aS). 



(2.4) 
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It is clear that p{0) = and 

= + a) + * (2a + 2) + - a + 2)] 

which is greater than 3/2 for sufficiently small Ai depending on a with \a\ < a and \5\ < Ai, since 
- a + 2> 7/4. Inequality (f2^ is thus proved. 
Now we define a new function 

g(7) = (1 + 6T{1 + + 7)^ - (1 + a5 + 7). 
From (|2.4p we have q{0) > 0. Furthermore, 

g'(7) = (l + <5r(l + 5^)2(1+ 7) -1 

which can be made positive for small A2 depending on a with \5\ < A2. The proof is complete by 
taking A = min{Ai, A2}. □ 

2.3 Appropriate extensions 

By using again an equivalence form for ^{Yl'^=i o-nlZnl^ > r} discussed in [7] with 1 < p < 2, we 
can similarly derive, without much difficulty, exact comparison for the upper tail probabilities of 
YlnLi ^n\Zn\^- We formulate this as a proposition as follows without a proof. 

Proposition 2.5. Let {(,n} be a sequence of i.i.d. Gaussian random variables N(a,l3'^), and 
{an}, {bn} be two sequences of positive real numbers such that Yl'^=i < 00, X]JS=i bn < 00 and 



E 

n=l 



/ P 



bn/(yl 



< 00 (2.5) 



for 1 < p < 2, (Tq = (^2"^=! (hi^^^ /3 with m = 2p/ {2 — p). Then as r —)• 00 



an\£,n\^ > iraa + \a\ ^ 1 

^n=l \ n=l 

00 

K.n=l \ n=l J ) 

Based on what we have observed for Gaussian random variables so far, it is reasonable to 
believe that after suitable scaling, two upper tail probabilities involving {a„} and {6n} separately 
are equivalent. Namely, we have the following. 
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Conjecture: Under suitable conditions on {an} and {bn}, for general i.i.d. random variables 
{.^n}, the following exact comparison holds 

P I E ^ ^(^/^(«) + aHa)) I IP I E ^ h{rfHb) + /(&)) I 

for some function h{r) satisfying limr^oo h{r) = oo, and for two suitable scaling coefficients /^(a) 
and g^{a) whose values at sequence a = {an} only depend on a and the structure of the distribution 
of ^1 (such as the mean, the variance, the tail behaviors, etc). 

In the next section, we show that indeed two upper tail probabilities in the logarithmic level 
are equivalent after some scaling. This adds more evidence of our conjecture. 



3 Logarithmic level comparison 

In this section, we illustrate the logarithmic level comparison for more general random variables 
{(.n} other than the Gaussian ones. 

Theorem 3.1. Let {^n} be a sequence of i.i.d. random variables whose common distribution 
satisfies E|^i| < oo and 

Urn u-PlogW{\^i\>u} = -c (3.1) 

n— >oo 

for some constants p > 1 and < c < oo. Suppose that a sequence of positive real numbers {a„} is 
such that X^^]^ On^'^ < oo with q given by ^ + ^ = 1. Then as r —)• oo 

logP jxjanlenl >r| ~-rf-c- ||a||-P. (3.2) 

Remark 3.1. If .^i is the standard Gaussian random variable, then p = 2 and c = 1/2 in condition 
(j3.1|) . If .^1 is an exponential random variable with density function e~^ on [0, oo), then p = c = 1. 
One can easily produce more examples. It is straightforward to deduce the following comparison 
result from (13.21). 



Corollary 3.2. Let {^n} be a sequence of i.i.d. random variables satisfying the assumptions in The- 
orem \3.1\ Suppose that two sequences of positive real numbers {a„} and satisfy Yl'^=i < 
and ^n^"^ < CO with q given by ^ + ^ = 1. Then as r ^ oo 



logP{E"=i&n|en| >r} Vllal 
9 



and 

logIP{E^l OnlCnl > r\\a\\q} 



1. 



logP{Er=lftn|en|>r||6||J 

The proof of Theorem 13.11 is based on the large deviation principle for random series which was 
derived in py. Let us recall a result in [Ij (revised a little for our purpose). 

Lemma 3.3 (U). Let {rjk} be a sequence of i.i.d. random variables with mean zero satisfying the 
following condition 

lim„_+oo log P < -u} = -ci; 

(3.3) 

lim„^ooii"^logP{r/i >u} = -C2, 
for some p > 1 and < ci,C2 < oo with min{ci,C2} < oo. Suppose {xk} is a sequence of real 
numbers such that X^fc^i l^^fcp^'^ < oo. Then the family {n^^ Sfct=i Xkrjk} satisfies the large deviation 
principle with speed and a rate function 

{oo oo I 

ip{uj) : UjXj = z> , z G M 
i=i i=i J 

where 

ci|t|P i/t<0; 



i/t = 0; 

C2|t|P i/t>0. 



oo 



Namely, for any measurable set ACM, 

— inf{/(j/) : y G interior of A} < lim inf n^^ log P < n^^ x^rfk ^ A\ 

I fe=l ) 

< limsupn ^logF<n ^'"y^x^rik £ A\ < —'m.i{I{y) : y £ closure of A\. 

Proof of Theorem \3.1\ We apply Lemma 13.31 to the i.i.d. random variables r]k = ICfcl ~ The 
condition ()3.ip implies that ()3.3p is fulfilled. Let us consider a special measurable set A = [l,oo). 
By using the Lagrange multiplier, it follows that 

— inf{/(y) : y G interior of A} = — inf{/(y) : y G closure of A} = — c||x||~^ 

(this can be also deduced from Lemma 3.1 of fl]). Then p.2p follows from the large deviation 
principle. □ 
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Now let us assume 



lim ti~PlogP{|6| >u} = -c. 

Then it follows easily that 

lim u-P^''log¥\\Ci\^ >u} = -c. 
So the logarithmic level comparison for can be similarly derived as follows. 

Proposition 3.4. Let k > be a positive real number, {^n} be a sequence of i.i.d. random variables 
whose common distribution satisfies E|^i|'^ < oo and 

lim u"?'logP{|^i| >u} = -c 

n— >oo 

for some constants < c < oo and p such that p/k > 1. Two sequences of positive real numbers 
{ttn} and {bn} satisfy X^J^Li '^"^'^ < oo and YlT=i ^"-^"^ < °° where q is given by ^ + | = 1. Then 



as r ^ oo 



and 



logg'{E^=l«n|gn|">r} _ 

logF{E^=if'n|e„l'=>r} ^ Vila 
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p/k 



^OS^ {En=i an\W>r\\a\U} 

iogp{E:r=i^nieni'=>rii6iij ^ ■ 



Appendix 

In this section, we make a few remarks on the conditions in Theorem 12.11 and Theorem 12. 2[ First, 
we note that conditions (j2.ip and (j2.2p are not very restrictive, and examples of sequences satisfying 
these conditions can be produced. For instance, we can consider two sequences with 

an/||a||2 ^ (-1)" 
bn/\\b\\2 n ■ 

To see the relation between (j2.ip and (j2.2p . let us post part of a useful theorem in p] from which 
many convergence results on infinite products and series can be easily derived. 

Lemma 3.5 (Part (a) of Theorem 1 in [9]). Let be a sequence of real numbers. If any two of 
the four expressions 

oo oo oo oo 

n=l n=l n=l n=l 

are convergent, then this holds also for the remaining two. 

11 



Under condition (12.211 in Theorem 12.21 it follows from this result that 



This implies that XlJ^Li ( fe"/ b I ) ^® convergent. The facts that 



bJWbhV . br 



1 ,11 II < OO and Tn—n- converge 

yield 



1 V an/ a 2/ On/ a 2 

n=l ^ / II II ^ n=l " ' 



nl o bn/\\0\\2 \ . 
2 ,, is convergent. 
^ an Walk ' 



n=l 
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